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ABSTRACT 

A  velocity  propagation  technique  is  described  that  deter¬ 
mines  velocity  vectors  at  the  points  of  a  contour,  based  on  the 
velocities  at  the  endpoints  of  ^,ne  contour  and  the  normal 
components  of  velocity  along  the  contour. 
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1.  Introduction 


Image  motion  can  be  described  by  a  velocity  or  optical 
flow  field  VCx,y,t)  which  gives  the  direction  and  speed  of 
movement  of  each  point  Cx,y)  in  an  image  at  time  t.  A 
variety  of  algorithms  have  been  proposed  for  determining 
this  optical  flow  velocity  field.  One  class  of  such  algori¬ 
thms  is  based  on  a  simple  linear  relationship  between  spa¬ 
tial  and  temporal  intensity  gradients  11,2,3].  These  gra¬ 
dients  are  related  to  the  optical  flow  by  the  following 
equation : 

l^u  +  lyV  +  l^  =  0  (1.1) 

or 

=  -  1^/lVll  (1.2) 

where  I^  is  the  temporal  intensity  change  at  (x,y);  I^  and  1^ 
are  the  spatial  intensity  changes  along  the  x  and  y  axes  at 
time  t;  |Vl(  is  the  magnitude  of  the  spatial  intensity  gradi¬ 
ent  at  that  point  (|Vl|  =  /l^+iZ ).  is  the  normal  compo¬ 
nent  of  the  velocity  at  that  point  (along  the  intensity  gra¬ 
dient);  and  u  and  v  are  the  components  of  the  velocity  in  the 
X  and  y  directions. 

However,  it  is  impossible  to  determine  both  u  and  v  or 
both  Vj^  and  (where  is  the  tangential  component)  from  the 
single  constraint  of  eq  (1.1)  or  eq  (1.2).  So  certain  further 
assumptions  about  the  organization  of  the  velocity  field  have 
to  be  made.  Horn  and  Schunck  [3],  for  example,  proposed  the 


assumption  that  the  velocity  varies  smoothly.  However,  along 
boundaries  between  objects  moving  with  different  velocities, 
the  resulting  velocity  field  is  unreliable,  because  this 
smoothness  assvuaption  becomes  invalid. 

A  similar  problem  (the  so-called  aperture  problem)  has 
been  studied  by  Batali  and  Ullman  [4]  in  connection  with  de¬ 
tecting  motion  along  image  contours  (zero-crossings  of 
Laplacians  in  their  work)  .  The  aperture  problem  is  that 
if  motion  is  detected  by  an  element  which  is  small  compared 
to  the  overall  contour,  then  the  only  motion  information  that 
one  can  obtain  is  the  component  perpendicular  to  the  local 
orientation  of  the  contour.  Motion  along  the  contour  cannot  be 
determined.  They  suggest  that  in  the  case  of  translation,  the 
overall  motion  can  be  recovered  by  combining  the  local  motion 
constraints.  Their  method  appears  to  rely  heavily  on  the 
assumption  that  the  motion  is  a  simple  translation  in  the 
image  plane. 

Yachida  [5]  proposed  an  iterative  scheme  for  propagating 
the  velocity  from  some  prominent  points  with  given  initial 
velocity  estimates.  This  scheme  was  also  based  on  the  smooth¬ 
ness  assumption  of  the  velocity  field. 

In  this  paper  we  present  a  local  constraint  between  the 
velocity  vectors  at  the  two  ends  of  a  small  line  segment. 

This  constraint  is  based  on  the  assumption  that  all 
motions  are  rigid,  and  it  is  used  to  derive  a 


propagation  procedure  which  can  assign  velocity  vectors  to 
all  points  on  an  image  contour,  based  on  the  velocity  vec¬ 
tors  at  the  endpoints  of  the  contour,  and  on  the  noinnal  com 
ponents  of  the  velocity  vectors  along  the  contour.  Since 
the  method  does  not  combine  information  across  an  edge,  it 


should  succeed  in  just  those  cases  where  a  method  such  as 
that  of  Horn  and  Schunk  [3]  would  have  difficulty. 


“4  1 


2 .  Theor 


2.1  The  local  constraint  and  the  propagation  formula 

Suppose  the  velocity  vectors  at  the  ends  of  a 

contour  AqA^  are  known  (see  Figure  1).  Consider  a  small 
line  segment  dS  along  the  contour  AqA^.  Assuming  that 
the  motion  is  a  rigid  motion  and  is  small  relative  to  the 
quantization  grid  and  contour  curvature,  the  component 
Vqq  of  Vq,  the  motion  at  Aq,  parallel  to  AqA^^  must  equal 
the  parallel  component  of  the  velocity  at  A^^; 

=  ""is  (2.1a) 

or 

Vq  •  ffS  =  *  dS.  (2.1b) 

where  Vq  and  are  the  velocity  vectors  at  the  two  ends  of 
the  line  dS,  and  dS  is  the  unit  vector  along  dS,  the  vector 
joining  Aq  to  A^^.  Rewriting  this  local  constraint  (eq.  2.1b) 
into  component  form,  we  obtain 

^  •  ds  =  (v^^H  +  v^^t)  .  ds 

~  ^In^  ’  ^  ^It^  *  ^  (2-2) 

where  and  are  the  normal  component  and  the  tangential 
component  of  the  velocity  vector  respectively,  and  n  and 
t  are  the  unit  vectors  in  the  normal  and  tangent  directions 
of  the  contour  at  A^.  From  Figure  1,  we  see  that 

''os  *  ''it  ''in 


Thus,  the  tangential  component  is 


=  CV^g  -  •  cosa)/sina  (2.3) 

where  a  is  the  angle  between  the  unit  vector  ^  and  the 
normal  vector  n  at  the  point  A^.  We  also  have  where 

6  is  the  auigle  between  the  x-eucis  and  the  normal  vector  ii, 
and  y  is  the  angle  between  the  x-axis  and  the  line  segment  dS. 

We  can  propagate  the  velocity  along  a  contour  using  eq. (2.3) 
because  the  first  projection  V^g  is  known  after  the  previous 
propagation  and  the  normal  component  can  be  confuted  by, 
e.g.,  the  methods  discussed  in  [3]  or  [4].  A  procedure  simi¬ 
lar  to  the  one  described  in  [3]  was  used  for  computing  normal 
velocity  components  in  the  experiments  described  in  the  follow¬ 
ing  section.  Once  is  confuted,  Vj^=Vj^e^®  can  be  obtained 
because 


V  =  /v^  +V^ 
''l  ’^''in  ''it 


0  =  3-  arctan 


(2.4) 


2.2  Error  analysis  and  a  correction  technique 

From  eq. (2.3)  the  new  estimate  of  the  temgent  component 
is  based  on  the  previous  projection  Vjjg  and  on  the  nor¬ 
mal  component  at  the  current  propagation  point.  Differ¬ 
entiating  this  equation  we  obtain 


+  _ i”.  dV 

OS  ^  3Vin 


*''it 

in  ^ 


-  ^''os  *  ^  .  f -  ■!“  <2-  =  ' 

sin  a 

Note  that  the  error  in  depends  on  the  error  in  the  previous 
projection  (<iVQg) ,  the  error  in  the  normal  component  at 
the  current  propagation  point  ,  and  the  error  in  the 

measurement  of  the  angle  a  (dot). 

The  result  of  these  various  errors  is  that  when  the  pro¬ 
pagation  reaches  the  velocity  vector  attributed  to 
by  the  propagation  procedure  will  differ  from  the  velocity  vec¬ 
tor  originally  computed  at  A^.  Therefore,  at  the  point  A^ 
we  compute  the  error  between  the  propagation  velocity  estimate 
and  the  original  velocity  vector 


-  V ' 

n  n  n 

If  this  error  is  less  than  some  tolerance,  then  this  propagation 
procedure  is  stopped  at  point  A^;  otherwise  a  correction  proce¬ 
dure  is  applied.  If  we  consider  the  error  as  having  been 
accumulated  in  the  previous  n  steps,  then  the  average  velocity 
error  in  one  step  is 


so  we  have  as  the  velocity  error  at  the  step  and 

propagate  this  velocity  error  step  by  step  backward  to 
correct  the  estimated  velocity  vector  at  each  point  along 


the  same  contour. 


3.  Experiments 
3.1  Implementation 

We  applied  the  propagation  technique  to  three  image  sequen¬ 
ces,  two  of  which  are  displayed  in  Figure  2.  In  both  sequences, 
the  object  motion  is  in  the  image  plane. 

The  propagation  technique  was  implemented  as  follows: 

1)  Velocity  vectors  are  first  determined  at  a  set  of  "corner" 
points  in  the  first  frame  by  the  technique  described  in  [6] . 
These  comer  points  are  marked  with  crosses  in  Figures  2  and  6. 

2)  The  velocity  vector  at  the  corner  is  propagated  along 
the  contours  that  meet  at  the  corner  until  a  second 
corner  point  is  encountered.  The  contours  are  followed 
by  a  very  simple  maximum  gradient  technique.  A  velocity 
vector  is  not  computed  at  every  pixel  on  the  contour, 
but  only  at  every  k  pixel,  to  reduce  the  error  in  a. 

3)  When  the  terminating  corner  point  is  reached,  the  propa¬ 
gation  is  stopped  and  the  error  velocity  vector  is  com¬ 
puted.  If  this  error  is  greater  than  a  preset  tolercuice, 
then  the  error  velocity  vector  is  back-propagated  along 


the  same  contour 


3.2  Results 

The  fiirst  example  is  a  single  translation  of  a  toy  airplane 
(see  Figure  2a).  In  this  simple  case  the  comparison  of  the 
velocity  vectors  before  and  after  the  correction  processing 
is  shown  in  Table  3.1.  From  the  first  and  third  columns  of 
Table  3.1,  it  is  clear  that  the  errors  are  accumulated  along 
the  propagation  path,  and  after  the  correction  the  values  of 
and  Vy  are  very  close  to  the  accurate  values  (in  this  case, 
they  are  -1.0). 

The  results  of  the  propagation  procedure  might  depend  cri¬ 
tically  on  the  direction  of  propagation  -  i.e.,  Aq  to  or 
vice  versa.  Experimented ly,  this  has  not  been  a  problem. 

The  results  in  Table  3.2  show  the  velocity  vectors  resulting 
from  a  "top-down"  versus  "bottom-up"  scan  of  one  of  the  con¬ 
tours  in  Figure  2a. 

In  the  second  case  (Figure  2),  motion  consists  of  a  trans¬ 
lation  and  a  rotation.  The  computed  velocity  vectors  of  the 
whole  airplane  and  of  two  major  parts  of  the  airplane  are  shown 
in  Figures  3,4,  and  5,  respectively. 

Figure  6  shows  a  moving  tool,  and  Figure  7  shows  the  velo¬ 
city  vectors  along  the  main  contour  of  this  tool. 


4 .  Conclusion  /  s 

'  -\ 

Th«  veloei^  propztga^ion-  technique  described  in  this 
paper -‘can,  at  least,  for  simple  motions,  reliably  determine 
motion  vectors  along  image  contours.  Although  the  propaga¬ 
tion  procedure  was  implemented  as  a  sequential  procedure 
which  traces  out  contours,  it  is  important  to  note  that  the 
process  is  not  inherently  sequential  and  can  be  formulated 
as  a  parallel  process  operating  on  a  network  of  image  contours. 

The  few  excunples  contained  in  this  paper  all  contained 
a  single  moving  object.  In  more  complex  scenes,  one  must 
consider  the  problem  of  avoiding  the  propagation  of  motion 
vectors  from  one  moving  object  to  another.  Also,  the  ability 
of  the  technique  to  deal  with  more  general  motions  was  not 
considered  in  this  paper.  All  of  these  issues  will  be  dealt 
with  in  subsequent  reports. 
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Table  3.1.  Velocity  vector  correction.  The  starred 
values  are  at  the  endpoints. 


Table  3.2. 


Effects  of  direction  of  propagation.  The  first 
four  colunms  headed  x,y,vx,vy  show  results 
for  one  direction  of  propagation,  and  the  last 
four  columns  show  results  for  the  other  direc- 
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Figure  3.  Velocity  field  using  the  propagation  technique 
along  the  contours  of  the  moving  airplane 
shown  in  Figure  2. 
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